Collecting an American Sign Language Corpus through the Participation of Native Signers
نویسندگان
چکیده
Animations of American Sign Language (ASL) can make more information, websites, and services accessible for the significant number of deaf people in the United States with lower levels of written language literacy – ultimately leading to fuller social inclusion for these users. We are collecting and analyzing an ASL motion-capture corpus of multi-sentential discourse to seek computational models of various aspects of ASL linguistics to enable us to produce more accurate and understandable ASL animations. In this paper, we will describe our motion-capture studio configuration, our data collection procedure, and the linguistic annotations being added by our research team of native ASL signers. This paper will identify the most effective prompts we have developed for collecting non-scripted ASL passages in which signers use particular linguistic constructions that we wish to study. This paper also describes the educational outreach and social inclusion aspects of our project – the participation of many deaf participants, researchers, and students.
منابع مشابه
Collecting and evaluating the CUNY ASL corpus for research on American Sign Language animation
While there is great potential for sign language animation generation software to improve the accessibility of information for deaf individuals with low written-language literacy, the understandability of current sign language animation systems is limited. Data-driven methodologies using annotated sign language corpora encoding detailed human movement have enabled some researchers to address se...
متن کاملCollecting a Motion-Capture Corpus of American Sign Language for Data-Driven Generation Research
American Sign Language (ASL) generation software can improve the accessibility of information and services for deaf individuals with low English literacy. The understandability of current ASL systems is limited; they have been constructed without the benefit of annotated ASL corpora that encode detailed human movement. We discuss how linguistic challenges in ASL generation can be addressed in a...
متن کاملLooking through phonological shape to lexical meaning: the bottleneck of non-native sign language processing.
In two studies, we find that native and non-native acquisition show different effects on sign language processing. Subjects were all born deaf and used sign language for interpersonal communication, but first acquired it at ages ranging from birth to 18. In the first study, deaf signers shadowed (simultaneously watched and reproduced) sign language narratives given in two dialects, American Sig...
متن کاملEye gaze during comprehension of American Sign Language by native and beginning signers.
An eye-tracking experiment investigated where deaf native signers (N = 9) and hearing beginning signers (N = 10) look while comprehending a short narrative and a spatial description in American Sign Language produced live by a fluent signer. Both groups fixated primarily on the signer's face (more than 80% of the time) but differed with respect to fixation location. Beginning signers fixated on...
متن کاملArabic Text to Arabic Sign Language Translation System for the Deaf and Hearing-Impaired Community
This paper describes a machine translation system that offers many deaf and hearingimpaired people the chance to access published information in Arabic by translating text into their first language, Arabic Sign Language (ArSL). The system was created under the close guidance of a team that included three deaf native signers and one ArSL interpreter. We discuss problems inherent in the design an...
متن کامل